Imitation Games with an Artiicial Agent: from Mimicking to Understanding Shape-related Iconic Gestures
نویسندگان
چکیده
We describe an anthropomorphic agent that is engaged in an imitation game with the human user In imitating natural gestures demonstrated by the user the agent brings together gesture recognition and synthesis on two levels of representation On the mimicking level the essential form features of the meaning bearing gesture phase stroke are extracted and reproduced by the agent Meaning based imitation re quires extracting the semantic content of such gestures and re expressing it with possibly alternative gestural forms Based on a compositional se mantics for shape related iconic gestures we present rst steps towards this higher level gesture imitation in a restricted domain
منابع مشابه
Imitation Games with an Artificial Agent: From Mimicking to Understanding Shape-Related Iconic Gestures
We describe an anthropomorphic agent that is engaged in an imitation game with the human user. In imitating natural gestures demonstrated by the user, the agent brings together gesture recognition and synthesis on two levels of representation. On the mimicking level, the essential form features of the meaning-bearing gesture phase (stroke) are extracted and reproduced by the agent. Meaning-base...
متن کاملSelf Organisation in Vowel Systems through Imitation
In this paper an artiicial life approach to the explanation of the shape of vowel systems is presented. A population of artiicial agents (small independent computer programs) that are each able to produce and perceive vowels in a human-like way, engages in imitation games. In these imitation games one agent makes a sound and another agent tries to imitate it. Both agents use their list of phone...
متن کاملA Model for the Representation and Processing of Shape in Coverbal Iconic Gestures
Verbal descriptions of object shape are frequently accompanied by iconic gestures expressing meaning via similarity to the referent. This paper presents a study examining the morphological variety of shape-related iconic gestures and the way they express aspects of object shape. It is shown that information about object extent, object boundary, and part structure is reflected both in coverbal g...
متن کاملThe role of objects and effects in action imitation: Comparing the imitation of object-related actions vs. gestures in 18-month-old infants.
This study aimed to systematically investigate 18-month-old infants' imitation of object-related actions compared to motorically similar gestures. An additional goal of the study was to examine the role of action effects on infants' imitation of target actions. One group of infants (n=17) observed object-related actions and gestures leading to salient effects (sounds or visual resp. social effe...
متن کاملInterpretation of Shape-Related Iconic Gestures in Virtual Environments
So far, approaches towards gesture recognition focused mainly on deictic and emblematic gestures. Iconics, viewed as iconic signs in the sense of Peirce, are different from deictics and emblems, for their relation to the referent is based on similarity. In the work reported here, the breakdown of the complex notion of similarity provides the key idea towards a computational model of gesture sem...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 2003